Method and arrangement for identifying a difference between a first 3d model of an environment and a second 3d model of the environment

ABSTRACT

The invention relates to a method for identifying a difference between a first 3D model of an environment and a second 3D model of the environment. The first and second 3D model each comprise a plurality of points or parts, wherein each point or part of the first and second model comprises geometrical information and texture information. Corresponding points or parts of the first and second 3D model are matched based on the geometrical information and/or the texture information. The matched points or parts of the first and second model are compared to determine at least one difference value based on the geometrical information and the texture information of the first and second model. A difference between the first and second model is identified if the at least one difference value exceeds a predetermined value. The invention also relates to an arrangement, a computer program, and a computer program product.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional of and claims priority to and thebenefit of U.S. Nonprovisional application Ser. No. 14/188,314, filedFeb. 24, 2014, the contents of which as are hereby incorporated byreference herein in their entirety.

BACKGROUND

1. Technical Field

The present disclosure relates to a method and arrangement foridentifying a difference between a first 3D model of an environment anda second 3D model of the environment. In particular, the presentdisclosure relates to identifying a difference, wherein the first andsecond 3D model each comprise a plurality of points or parts, andwherein each point or part of the first and second model comprisesgeometrical information and texture information

The present disclosure also relates to a method and arrangement foridentifying a difference between a 3D model of an environment and theenvironment as reproduced at another timing. In particular, the presentdisclosure relates to identifying a difference, wherein saidreproduction of the environment comprising at least one 2D image, andwherein each point or part of the first 3D model comprises geometricaland texture information

2. Description of Related Art

A fast growing market both in civilian and military business isgeographical information systems. Knowledge about geographicalconditions forms a fundamental decision support to companies,authorities and in the military. The geographical information cancomprise digital maps having superposed information layers such asinfrastructure, terrain type and different types of objects. This way ofproviding digital maps is time consuming and comprises forming twodimensional maps comprising capturing images of the terrain from anaircraft and post-processing of the captured images. It is an even moretime consuming process to form three dimensional maps from capturedimages or range data sets of the terrain/infrastructure.

WO 2009/003529 relates to another type of geographical informationsystem. It relates to an arrangement and a method for providing a threedimensional map representation of an area. The arrangement comprises aprocessing unit arranged to, for a plurality of time recorded,overlapping images of the area to be stereo processed, associatenavigation states so that each pixel of each time recorded image iscorrelated to a corresponding navigation state and to perform the stereoprocessing based on the associated navigation states that all pixels inthe map representation are specified in three geographical dimensions.

It is desirable to detect changes in the environment. These changes canbe due natural variations like flooding, earthquakes, moving glaciers,falling rocks, erosions, or the like. They can also be due to growingplants or trees, due to different seeds on fields or the like. They canalso be due to human made interactions like construction working (forexample for building infrastructure, buildings, etc. . . . ), removingor destroying of constructions (for example, due to war, due to fire,due to forces of nature, due to dismantling or demolishing of buildings,constructions for other purposes, etc.).

For detecting these changes, a common way is to compare maps or images.This is often done in a manual way to find differences between them.This is a time-consuming task.

BRIEF SUMMARY

One object of the present invention is to improve the process ofidentifying differences in an environment.

This object is achieved by method for identifying a difference between afirst 3D model of an environment and at least a second 3D model of theenvironment. The first and second 3D model each comprises a plurality ofpoints or parts, wherein each point or part of the first and secondmodel comprises geometrical information and texture information.Corresponding points or parts of the first and second 3D model arematched based on the geometrical information and/or the textureinformation. The matched points or parts of the first and second modelare compared to determine at least one difference value based on thegeometrical information and the texture information of the first andsecond model.

This method can be performed in a highly automated way, thus reducingthe amount of time and/or workload an operator has to spend foridentifying differences.

In one example, an uncertainty for the geometrical information isassociated to each point or part of the respective 3D model and anuncertainty for the texture information is associated to each point orpart of the respective model. A difference between the first and secondmodel is identified for each point or part based on the determined atleast one difference value and based on the geometrical informationuncertainty for the respective model and/or the texture informationuncertainty for the respective model.

This has the advantages that one can differ between differences whichoriginate from measurement uncertainties and differences which originatefrom actual changes in the environment.

In one example the geometrical information uncertainty at each point orpart is based on a local geometry of the 3D model at that point or part.

By doing so a refined method is achieved for differing betweendifferences which originate from measurement uncertainties anddifferences which originate from actual changes in the environment.

In one example, the geometrical information uncertainty and/or textureinformation uncertainty is based on a number of measurements on whichthe respective model is based for each point or part of the respective3D models.

In one example, the geometrical information uncertainty and/or textureinformation uncertainty is based on a spread in measurements on whichthe respective model is based for each point or part of the respective3D models.

In one example, the geometrical information uncertainty comprises avalue for the uncertainty in at least two directions and/or at least onevalue related to a distance and/or at least one probability value.

All these examples present methods, which in a refined way can differbetween differences which originate from measurement uncertainties anddifferences which originate from actual changes in the environment.

In one example the texture information comprises colour informationand/or grey scale information. By doing so, even differences which donot originate from a changed geometrical shape in the environment can beidentified.

In one example the texture information uncertainty comprises anuncertainty related to the colour and/or greyscale and/or a frequencyvalue and/or a grey scale value and/or a percentage value.

This allows differing between differences which originate from impreciseequipment, for example imprecise camera sensors, and differences whichactually originate from differences in the environment.

In one example comparing the first and second 3D model comprises, foreach point or part of the first 3D model, searching for a closest pointin the second 3D model and to determine the at least one differencebased on a found closest point in the second 3D model.

This will result in that differences which originate from shifts in themodels will not falsely be identified as differences in the environment.

In one example comparing the first and second 3D model furthercomprises, for each point or part of the first 3D model, searching for aclosest point in the second 3D model to determine at least one firstdifference value for that point or part. It also comprises, for eachpoint or part of the second 3D model, searching for a closest point inthe first 3D model to determine at least one second difference value forthat point or part. The at least one difference value is determinedbased on the at least one first difference value and the at least onesecond difference value.

By doing so more differences in the environment can be identified. Forexample, both additional constructions/objects and removedconstructions/objects will be identified.

In one example the geometrical information of the first and the second3D model is defined by a mesh modelling the environment in threedimensions, said mesh comprising nodes interconnected by edges andhaving surfaces boarded by the edges.

This allows for a practical implementation of the method.

In one example a plurality of the nodes and/or edges and/or surfaces ofthe mesh are associated to an attribute. The attribute comprises thetexture information and/or the texture information uncertainty and/orthe geometrical information uncertainty.

This allows for a practical implementation of the method as well.

In one example the geometrical information comprises coordinateinformation in a three dimensional coordinate system, such as ageo-referenced coordinate system.

In this way identified differences in the environment can be connectedto specific positions.

In one example identified differences are classified, which comprisesdetermining whether the identified difference is caused by naturalvariations.

This allows differing between differences caused by human interactionactions and differences caused by nature.

In one example the determination whether the identified difference iscaused by natural variations is based on attribute informationassociated to the respective 3D model or measurements on which therespective model is based. The attribute information comprises at leastone of the following: time of the year, daytime, resolution, from whichsource or sources the 3D model or measurement is originating, in whichcolours images are taken.

By doing this the classification can be automated.

In one example, the information related to the part or points of themodels for which a difference has been identified is presented.

In one example the presented information comprises informationidentifying the point or part for which the difference has beenidentified and a presentation of the identified difference.

In one example the presented information is visualized in the firstand/or second 3D model.

The above examples facilitate for a user of the method to drawconclusions from the identified differences.

The object is also achieved by a computer program, which comprises aprogram code for executing the method for identifying a differencebetween a first 3D model of an environment and a second 3D model of theenvironment.

The object is also achieved by a computer program product, whichcomprises a program code stored on a computer readable media forexecuting the method for identifying a difference between a first 3Dmodel of an environment and a second 3D model of the environment.

The object is also achieved by an arrangement for identifying adifference between a first 3D model of an environment and a second 3Dmodel of the environment. The arrangement comprises a memory or meansfor having access to the first and second 3D model. The first and second3D model each comprises a plurality of points or parts, wherein eachpoint or part of the first and second model comprises geometricalinformation and texture information. The arrangement also comprises aprocessing element. The processing element is arranged to matchcorresponding points or parts of the first and second 3D model based onthe geometrical information and/or the texture information It is alsoarranged to compare the matched points or parts of the first and secondmodel to determine at least one difference value based on thegeometrical information and the texture information of the first andsecond model.

The arrangement performs the process of identifying differences in anenvironment in a highly automated way, thus reducing the amount of timeand/or workload an operator has to spend for identifying differences.

In one example, the memory or means for having access to the first andsecond 3D model are arranged to store an uncertainty for the geometricalinformation. The geometrical information uncertainty is associated toeach point or part of the respective 3D model. The memory or means forhaving access to the first and second 3D model are also arranged tostore an uncertainty for the texture information. The textureinformation uncertainty is associated to each point or part of therespective model. The processing element is further arranged to identifya difference between the first and second model for each point or partbased on the determined at least one difference value and based on thegeometrical information uncertainty for the respective model and/or thetexture information uncertainty for the respective 3D model.

This has the advantages that one can differ between differences whichoriginate from measurement uncertainties and differences which originatefrom actual changes in the environment.

In one example the processing element is further arranged to classify anidentified difference between the first and second model. This comprisesto determine whether the identified difference is caused by naturalvariations.

This allows differing between differences caused by human interactionactions and differences caused by nature.

In one example the arrangement comprises a presentation unit. Thepresentation unit is arranged to present information related to the partor points of the models for which a difference has been identified.

The object is also achieved by a method for identifying a differencebetween a 3D model of an environment and the environment as reproducedat another timing. The reproduction of the environment comprises atleast one 2D image, wherein each point or part of the 3D model comprisesgeometrical and texture information. Corresponding points or parts ofthe 3D model and the at least one 2D image are matched based on thetexture information in the 3D model and texture information in the atleast one 2D image. At least one difference value for the textureinformation is determined for each corresponding part or point of thefirst 3D model and the at least one 2D image.

This has the advantage that one does not need to have two 3D models ofthe environment. This allows determining difference values, for example,even for moments of time where no 3D model is available.

In one example, a geometrical information uncertainty is associated toeach point or part of the 3D model, and/or a texture informationuncertainty is associated to each point or part of the 3D model. Adifference between the 3D model and the at least one 2D image isidentified based on the determined at least one difference value, andbased on the geometrical information uncertainty and/or the textureinformation uncertainty.

This allows better identifying differences in the environment comparedto a moment of time where no 3D model is/was available. It furtherallows to differ between differences which originate from measurementuncertainties and differences which originate from actual changes in theenvironment.

In one example, information related to the part or points of the 3Dmodel for which a difference has been identified is presented.

This facilitates for a user of the method to draw conclusions from theidentified differences.

The object is also achieved by an arrangement for identifying adifference between a 3D model of an environment and the environment asreproduced at another timing. The arrangement comprises a memory ormeans for having access to the reproduction of the environment and tothe first 3D model. The reproduction of the environment comprises atleast one 2D image. Each point or part of the 3D model comprisesgeometrical and texture information. The arrangement also comprises aprocessing element. The processing element is arranged to matchcorresponding points or parts of the 3D model and the at least one 2Dimage reproducing the environment based on the texture information inthe 3D model and texture information in the at least one 2D image. It isalso arranged to determine at least one difference value for the textureinformation for each corresponding part or point of the first 3D modeland the at least one 2D image.

The arrangement performs the process of identifying differences in anenvironment in a highly automated way, thus reducing the amount of timeand/or workload an operator has to spend for identifying differences.The arrangement further has the advantage that one does not need to havetwo 3D models of the environment. This allows determining differencevalues, for example, even for moments of time where no 3D model isavailable.

In one example the memory or means for having access to the 3D model isfurther arranged to store a geometrical information uncertaintyassociated to each point or part of the 3D model and to store a textureinformation associated to each point or part of the 3D model. Theprocessing element is further arranged to identifying a differencebetween the 3D model and the 2D image for each point or part based onthe determined at least one difference value and based on thegeometrical information uncertainty and/or the texture informationuncertainty.

This allows better identifying differences in the environment comparedto a moment of time where no 3D model is/was available. It furtherallows to differ between differences which originate from measurementuncertainties and differences which originate from actual changes in theenvironment.

In one example the arrangement further comprises a presentation unitarranged to present information related to the part or points of themodel and/or image for which a difference has been identified.

This facilitates for a user of the arrangement to draw conclusions fromthe identified differences.

The object is also achieved by a computer program comprising a programcode for executing the method for identifying a difference between a 3Dmodel of an environment and the environment as reproduced at anothertiming.

The object is also achieved by a computer program product comprising aprogram code stored on a computer readable media for executing themethod for identifying a difference between a 3D model of an environmentand the environment as reproduced at another timing.

BRIEF DESCRIPTION OF THE TH FIGURES

FIG. 1 shows a side view of an example of a first 3D model and a second3D model.

FIG. 2 is flow chart illustrating one example of a method foridentifying a difference between a first 3D model of an environment anda second 3D model of the environment.

FIGS. 3a-3c illustrates examples for comparing a first and second 3Dmodel for each point or part.

FIG. 4 illustrates schematically one example of a 3D model.

FIG. 5 illustrates schematically an example of an uncertainty associatedto points or parts of a 3D model.

FIG. 6 is a block scheme illustrating an example of an arrangement foridentifying a difference between a first 3D model of an environment anda second 3D model of the environment.

FIG. 7 is flow chart illustrating one example of a method foridentifying a difference between a first 3D model of an environment andthe environment as reproduced at another timing.

FIG. 8 is a block scheme illustrating an example of an arrangement foridentifying a difference between a first 3D model of an environment andthe environment as reproduced at another timing.

DETAILED DESCRIPTION OF VARIOUS EMBODIMENTS

In FIG. 1, a difference between a first 3D model 101 a of an environmentand a second 3D model 101 b of the environment is schematicallyillustrated. The first 3D model is illustrated with a full line. Thesecond 3D model is illustrated with a broken line. The first 3D model101 a comprises a plurality of first points or parts 117 a. Each firstpoint or part 117 a comprises geometrical information and textureinformation. The second 3D model 101 b comprises a plurality of secondpoints or parts 117 b. Each second point or part 117 b comprisesgeometrical information and texture information. Only a few of the firstpoints or parts 117 a and second points or parts 117 b are shown in thefigure in order to make the figure clear.

The geometrical information comprises coordinate information in a threedimensional coordinate system. In one example, the coordinate system isa geo-referenced coordinate system. The texture information comprises inone example colour information and/or grey scale information.

In one example the first 3D model and/or the second 3D model is formedbased on 2D images, distance measurements such as LIDAR etc. When basingthe 3D model on 2D images, the 3D models may have been provided byestablishing stereo matching correspondence for stereo pairs based ondifferent combinations of two 2D images and building the 3D model basedon the established stereo matching correspondence for the stereo pairs.Details related to building 3D models from 2D images are known in theart and is left out from this description.

The first 3D model and/or the second 3D model may be represented innumerous ways. In one example, at least one of the 3D models isrepresented as a textured mesh. In one example, at least one of the 3Dmodels is represented as a point cloud. In one example, at least one ofthe 3D models is represented as a voxel.

In one example, an uncertainty for the geometrical information isassociated to each point or part of the respective 3D model. Thus thefirst points or parts 117 a of the first 3D model 101 a are eachassociated to a geometrical information uncertainty. Further, the secondpoints or parts 117 b of the second 3D model 101 b are each associatedto a geometrical information uncertainty. In the same way, a textureinformation uncertainty is associated to each point or part of therespective model.

The geometrical information uncertainty and the texture informationuncertainty can be formed by uncertainties related to one or a pluralityof factors. Thus, different types of geometrical informationuncertainties and texture information uncertainties can be accountedfor. Some examples are given below. In one example geometricalinformation uncertainty and/or the texture information uncertainty foreach point or part is based on the uncertainties of different types. Thegeometrical information uncertainty and/or the texture informationuncertainty for each point or part can be a weighted sum ofuncertainties of different types.

Some types of geometrical information uncertainties and/or textureinformation uncertainties are isolated to individual points or parts 117a, 117 b while other types of geometrical information uncertaintiesand/or texture information uncertainties are common for larger areas.Thus, the latter types of geometrical information uncertainties and/ortexture information uncertainties are common for a plurality of pointsor parts.

The geometrical information uncertainty and/or the texture informationuncertainty may be a value for the uncertainty in one, two or threedirections. The value may be related to a distance. The value may be aprobability value. In one example, the geometrical informationuncertainty and/or texture information uncertainty is represented as ahypothesis.

In one example, the geometrical information uncertainty at each point orpart is based on a local geometry of the 3D model at that point or part.

In one example, the geometrical information uncertainty and/or textureinformation uncertainty is based on a number of measurements on whichthe respective 3D model is based for each point or part of therespective 3D models.

In one example, the geometrical information uncertainty and/or textureinformation uncertainty is based on a spread in measurements on whichthe respective model is based for each point or part of the respective3D models.

In one example, the texture information uncertainty comprises anuncertainty related to the colour and/or greyscale. In one example, thetexture information uncertainty comprises an uncertainty related to afrequency value. In one example, the texture information uncertaintyrelates to a grey scale value. In one example, the texture informationuncertainty relates to a percentage value.

As is understood from the above, one, some or all of the examples ofgeometrical information uncertainties and texture informationuncertainties described herein can be selected, along with other, notdisclosed types of uncertainties to form a geometrical informationuncertainty and to form a texture information uncertainty.

In FIG. 2, a method 200 for identifying a difference between a first 3Dmodel of an environment and a second 3D model of the environment isillustrated. The method is based on the prerequisite that the first andsecond 3D model each comprises a plurality of points or parts and thateach point or part of the first and second model comprises geometricalinformation and texture information.

The method comprises a step of matching 210 the first 3D model with thesecond 3D model. The matching is performed such that correspondingpoints or parts of the first and second 3D model are matched based onthe geometrical information and/or the texture information. The firstand the second model may have different accuracy, which may be takeninto account in the matching.

There are many ways known in the art for achieving matching of data intwo models. The matching is in one example a global matching. This meansthat the first and second models as a whole are matched usingtranslation and/or rotation and/or a higher order model. The matchingmay for example involve using least square method(s).

In one example, wherein the models are formed based on images, thematching involves performing bundle adjustments. Given a set of imagesdepicting a number of 3D points from different viewpoints, bundleadjustment can be defined as the problem of simultaneously refining the3D coordinates describing the scene geometry as well as the parametersof the relative motion and the optical characteristics of the camera(s)employed to acquire the images, according to an optimality criterioninvolving the corresponding image projections of all points. Bundleadjustments are known in the art and thus not described here anyfurther.

In a next step, the matched points or parts of the first and secondmodel are compared 220 to determine a relation between the first 3Dmodel and the second 3D model. This is done by determining at least onedifference value based on the geometrical information and the textureinformation of the first and second model. In one example, the comparing220 comprises for each point or part of the first 3D model to search fora closest point in the second 3D model. The at least one difference isdetermined based on a found closest point in the second 3D model. Thus,a local search is performed for a closest point in the second 3D modeland the difference value is determined based on the result of thissearch. In one example, a difference between the first and second modelis identified if the at least one difference value exceeds apredetermined value.

In one example, an uncertainty for the geometrical information isassociated to each point or part of the respective 3D model and/or anuncertainty for the texture information is associated to each point orpart of the respective model. In one optional step, the method thenfurther comprises a step of identifying 230 a difference between thefirst and second models for each point or part based on the determinedat least one difference value and based on the geometrical informationuncertainty for the respective model and/or the texture informationuncertainty for the respective model. Examples of how the geometricalinformation uncertainty and the texture information uncertainty can bedetermined have been described in this disclosure.

The method further comprises an optional step of classifying 240 theidentified difference. In one example the classification is based onwhether an identified difference is caused by natural variations or byother causes such as humans, natural disasters, etc.

If the 3D models or the measurements on which the models are based isassociated to information related to the time of the year, daytime,resolution, from which source the measurement is originating, in whichcolours image are taken, etc., this information can be used fordetermining whether an identified difference is based on naturalvariations or not. When building a 3D model of an area where the seasonshave great impact on the appearance of the area, measurements can besorted out or kept according to the seasons at which they were taken.One example is areas which in winter usually are covered by snow and/orwhich have deciduous trees. In these areas both colour can changebetween the seasons, but also the height profile. If an area gets lot ofsnow in winter, but roads are kept free from snow during winter, theheight profile in this area changes during seasons. In that case it isadvantageous to choose measurement from only one season, for examplesummer in building the 3D models. Also sorting out measurementsaccording to any other predetermined requirement might be helpful, ifthat requirement has an impact on the appearance of the environment oron the possibility to built accurate 3D models.

The method further comprises an optional step of presenting 250information related to the part or points of the models for which adifference has been identified. The presented information comprises inone example information identifying the point or part for which thedifference has been identified and a presentation of the identifieddifference. In one example, the presented information is visualized inthe first or second 3D model.

In FIGS. 3a-3c , a step of comparing a first and second 3D modelcomprises for each point or part of the first 3D model 301 a searchingfor a closest point in the second 3D model 301 b and to determine the atleast one difference d based on a found closest point in the second 3Dmodel. The search is in the illustrated example performed in a radius inrelation to the point or part in the first model. In one example, thesearch is performed in two dimensions. In one example the search isperformed in three dimensions. The search is performed within a searchradius d_(max).

In FIGS. 3b-c the step of comparing a first and a second 3D modelcomprises for each point or part of the first 3D model searching for aclosest point in the second 3D model to determine at least one firstdifference value d_(a) for that point or part, for each point or part ofthe second 3D model searching for a closest point in the first 3D modelto determine at least one second difference value d_(b) for that pointor part, and to determine the at least one difference value based on theat least one first difference value d_(a) and the at least one seconddifference value d_(b).

Using the procedure as described in relation to FIGS. 3a-3c ensures thatobjects present in one of the 3D models but not the other are found.

In the example of FIG. 4, geometrical information of a first 2D modeland/or a second 3D model 401 is defined by a mesh modelling theenvironment in three dimensions. The mesh comprises nodes 402interconnected by edges 403 and having surfaces 404 boarded by theedges. Each node and/or edge and or surface is associated to a 3Dcoordinate in a geographical coordinate system. In one example, aplurality of the nodes and/or edges and/or surfaces of the mesh areassociated to an attribute. The attribute comprises the textureinformation. The attribute comprises in one example also a textureinformation uncertainty and/or a geometrical information uncertainty.

In FIG. 5, a geometrical information uncertainty and/or textureinformation uncertainty comprises a value for the uncertainty in atleast two directions. The geometrical information uncertainty and/ortexture information uncertainty comprises in one additional oralternative example at least one value related to a distance and/or atleast one probability value.

In FIG. 6, an arrangement 600 for identifying a difference between afirst 3D model 101 a of an environment and a second 3D model 101 b ofthe environment is illustrated. The arrangement 600 comprises a memory654 for having access to the first and second 3D model. In one example,the memory is arranged to temporarily store relevant parts of the firstand second model. In one example the arrangement comprises means forhaving access to the first and second 3D model. In one example the firstand second 3D model is stored in a database. In one example the firstand second 3D model are stored at one or more remote locations and themeans for having access to the first and second 3D model are arranged tosupply the first and second 3D model via a network to the arrangement.In one example the first and second 3D model are supplied via wirelesscommunication. In one example the first and second 3D model are suppliedvia wired communication. The access to the first and second model is inone example provided by means of an interface 656. The first and second3D model each comprises a plurality of points or parts. Each point orpart of the first and second models comprises geometrical informationand texture information. In one example the memory comprises the firstand second 3D model.

In one example, the memory 654 or means for having access to the firstand second 3D model is arranged to store an uncertainty for thegeometrical information, which uncertainty is associated to each pointor part of the respective 3D model, and it is arranged to store anuncertainty for the texture information, which uncertainty is associatedto each point or part of the respective model.

The arrangement 600 further comprises a processing element 650. Theprocessing element 650 is arranged to match corresponding points orparts of the first and second 3D models based on the geometricalinformation and/or the texture information. This is in one exampleperformed in a matching element 651 The processing element 650 isfurther arranged to compare the matched points or parts of the first andsecond model to determine at least one difference value based on thegeometrical information and the texture information of the first andsecond model. The comparing is in one example performed in a comparingelement 652. The processing element 650 is in one example arranged toidentify a difference between the first and second model if the at leastone difference value exceeds a predetermined value.

In one example, the processing element 650 is arranged to identify adifference between the first and second models for each point or partbased on the determined at least one difference value and based on thegeometrical information uncertainty for the respective model and/or thetexture information uncertainty for the respective model. This is in oneexample performed in a difference identifying element 653.

In one example the processing element 650 is formed as one or moreprocessing units. In one example the processing element 650 is severalprocessing units. In one example the processing units are located atremote locations and arranged to communicate with each other.

In one example the processing element 650 is further arranged toclassify an identified difference between the first and second model.The classification comprises determining whether the identifieddifference is caused by natural variations.

The processing element 650 comprises in one example a computer programcomprising a program code for executing the identifying of a differencebetween a first 3D model of an environment and a second 3D model of theenvironment.

In one example the arrangement 600 further comprises a presentation unit655. The presentation unit is arranged to present information related tothe part or points of the first and/or second 3D model for which adifference has been identified. In one example the presentation unit isa display. In one example the presentation unit is a screen. In oneexample the presentation unit is a printer. In one example thepresentation unit is a projector. In one example the presentation unitis arranged to receive information from the processing element.

In FIG. 7, a method 700 for identifying a difference between a 3D modelof an environment and the environment as reproduced at another timing,wherein said reproduction of the environment comprises at least one 2Dimage, is illustrated. Each point or part of the 3D model comprisesgeometrical and texture information. The method comprises the followingsteps.

In a first step, corresponding points or parts of the 3D model and theat least one image are matched 706 based on the texture information inthe 3D model and texture information in the at least one 2D image.

There are many ways known in the art for achieving matching a 3D modelwith 2D images. The matching is in one example a global matching. In oneexample, one or a plurality of images which have been used for buildingthe 3D model is used for matching the 2D image. Then, textureinformation may be matched. For example, the matching is performed usingtranslation and/or rotation and/or a higher order model. The matchingmay for example involve using least square method.

In one example, wherein the 3D model is formed based on images, thematching involves performing bundle adjustments. Bundle adjustments areknown in the art and thus not described here any further. In one examplethe matching involves establishing point correspondence between the 3Dmodel and the at least one 2D image.

In one additional or complementing example, georeferencing informationis used in the matching.

In a next step, at least one difference value for the textureinformation for each corresponding part or point of the first 3D modeland the at least one 2D image is determined.

In one example, a geometrical information uncertainty is associated toeach point or part of the 3D model and/or a texture informationuncertainty is associated to each point or part of the 3D model. In thisexample, the method comprises an optional step 708 of identifying adifference between the 3D model and the at least one 2D image based onthe determined at least one difference value, and based on thegeometrical information uncertainty and/or the texture informationuncertainty. Examples of how the geometrical information uncertainty andthe texture information uncertainty can be determined are describedearlier in this disclosure.

The method further comprises an optional step of presenting 709information related to the part or points of the 3D model for which adifference has been identified.

In FIG. 8, an example of an arrangement 800 for identifying a differencebetween a first 3D model of an environment and the environment asreproduced at another timing is described. The arrangement 800 comprisesa memory 864 or means for having access to the reproduction of theenvironment comprising at least one 2D image, and to the first 3D model,wherein each point or part of the first 3D model comprises geometricaland texture information. In one example the memory 864 comprises thereproduction of the environment and the first 3D model. In one examplethe arrangement comprises means for having access to the reproduction ofthe environment and the first 3D model. In one example the reproductionof the environment and the first 3D model are stored in a database. Inone example the reproduction of the environment and the first 3D modelare stored at one or more remote locations and the means for havingaccess to the reproduction of the environment and the first 3D model arearranged to supply the reproduction of the environment and the first 3Dmodel via a network to the arrangement. In one example the reproductionof the environment and the first 3D model are supplied via wirelesscommunication. In one example the reproduction of the environment andthe first 3D model are supplied via wired communication. The access tothe first and second model is in one example provided by means of aninterface 866.

The arrangement 800 further comprises a processing element 860, arrangedto match corresponding points or parts of the 3D model and the at leastone image based on the texture information in the 3D model and textureinformation in the at least one 2D image. The matching is in one exampleperformed in a matching element 861. The processing element is furtherarranged to determine at least one difference value for the textureinformation for each corresponding part or point of the first 3D modeland the at least one 2D image. This is in one example performed in adifference value determining element 862. The processing element 860 isin one example arranged to identify a difference between the 3D modeland the at least one 2D image if the at least one difference value forthe texture information exceeds a predetermined value. In one example,the memory 864 or means for having access to the first and second 3Dmodel is arranged to store a geometrical information uncertaintyassociated to each point or part of the 3D model and arranged to store atexture information associated to each point or part of the 3D model.

In one example, the processing element 650 is arranged to identifying adifference between the first and second model for each point or partbased on the determined at least one difference value and based on thegeometrical information uncertainty and/or the texture informationuncertainty. This is in one example performed in a differenceidentifying element 863.

In one example the processing element 860 comprises one or moreprocessing units. In one example the processing element comprisesseveral processing units. In one example the processing units arelocated at remote locations and arranged to communicate with each other.

In one example the arrangement further comprises a presentation unit865. The presentation unit 865 is arranged to present informationrelated to the part or points of the model and/or image for which adifference has been identified. In one example the presentation unit isa display. In one example the presentation unit is a screen. In oneexample the presentation unit is a printer. In one example thepresentation unit is a projector. In one example the presentation unitis arranged to receive information from the processing element.

Many modifications and other embodiments of the invention set forthherein will come to mind to one skilled in the art to which thisinvention pertains having the benefit of the teachings presented in theforegoing descriptions and the associated drawings. Therefore, it is tobe understood that the invention is not to be limited to the specificembodiments disclosed and that modifications and other embodiments areintended to be included within the scope of the appended claims.Although specific terms are employed herein, they are used in a genericand descriptive sense only and not for purposes of limitation.

1. A method (700) for identifying a difference between a 3D model of anenvironment and the environment as reproduced at another timing, saidreproduction of the environment comprising at least one 2D image,wherein each point or part of the 3D model comprises geometrical andtexture information, the method comprising the steps of: matching (706)corresponding points or parts of the 3D model and the at least one 2Dimage based on the texture information in the 3D model and textureinformation in the at least one 2D image; and determining (707) at leastone difference value for the texture information for each correspondingpart or point of the first 3D model and the at least one 2D image.
 2. Amethod according to claim 1, wherein a geometrical informationuncertainty is associated to each point or part of the 3D model and/orwherein a texture information uncertainty is associated to each point orpart of the 3D model, further comprising a step (708) of identifying adifference between the 3D model and the at least one 2D image based onthe determined at least one difference value, and based on thegeometrical information uncertainty and/or the texture informationuncertainty.
 3. A method according to claim 2, further comprising a stepof presenting (709) information related to the part or points of the 3Dmodel for which a difference has been identified.
 4. An arrangement(800) for identifying a difference between a 3D model of an environmentand the environment as reproduced at another timing, the arrangementcomprising: a memory (864) or means for having access to thereproduction of the environment, which comprises at least one 2D image,and to the 3D model, wherein each point or part of the 3D modelcomprises geometrical and texture information; and a processing element(860), arranged to match corresponding points or parts of the 3D modeland the at least one 2D image reproducing the environment based on thetexture information in the 3D model and texture information in the atleast one 2D image, and to determine at least one difference value forthe texture information for each corresponding part or point of the 3Dmodel and the at least one 2D image.
 5. An arrangement according toclaim 4, wherein the memory (864) or means for having access to the 3Dmodel is arranged to store a geometrical information uncertaintyassociated to each point or part of the 3D model and arranged to store atexture information associated to each point or part of the 3D model,and wherein the processing element (650) is arranged to identifying adifference between the 3D model and the 2D image for each point or partbased on the determined at least one difference value and based on thegeometrical information uncertainty and/or the texture informationuncertainty.
 6. An arrangement according to claim 4, further comprisinga presentation unit (865) arranged to present information related to thepart or points of the model and/or image for which a difference has beenidentified.
 7. A non-transitory computer program comprising a programcode for executing the method for identifying a difference between a 3Dmodel of an environment and the environment as reproduced at anothertiming, according to claim
 1. 8. A non-transitory computer programproduct comprising a program code stored on a non-transitory computerreadable media for executing the method for identifying a differencebetween a 3D model of an environment and the environment as reproducedat another timing, according to claim 1.